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(S) Stereoscopic image display system. 

(57) An image display system which provides first 
and second images such that the right eye and 
the left eye of an observer see the first and 
second images at different times, respectively. 
The image display system comprises a camera 
for taking a picture of the observer and then 
outputting an image of the observer; a liquid 
crystal display device transparent to light for 
displaying the first and second images at the 
different times, respectively; a back-lighting 
device which displays back light images to 
illuminate the liquid crystal display device from 
a back side thereof, at the different times ; and 
an optical element for giving directivity to back 
light emitted by the back-lighting device so that 
the back-lighting device provides back light 
illuminations of the LCD device for the right and 
left eyes at the different times. The apparatus 
detects centroids or contours of images of the 
observer taken by the camera, and generates 
the back-light images on the basis of the cen- 
troids or contours. The apparatus synchronizes 
the display of the back-light images with the 
display of the first and second images, respect- 
ively. 
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BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention relates to a display system 
for displaying an image, and more particularly to a 
display system for displaying a stereoscopic image 
for industrial, medical, or domestic use. 

DESCRIPTION OF THE RELATED A*RT 

In a conventional stereoscopic display system, 
an observer wears glasses for separating right and 
left images from each other whereby right and left 
eyes of the observer can selectively see right and left 
target images, respectively, which are displayed on 
an image screen in a time-division fashion. In another 
conventional technique, a lenticular plate is attached 
to an image screen so that the lenticular plate can 
separate right and left images from each other and 
thus right and left eyes of the observer can selectively 
see right and left target images, respectively. 

Figure 1 illustrates an example of the configura- 
tion of the above-described conventional stereoscop- 
ic-image display system, which includes glasses 60 
capable of separating rig ht and left i mages from each 
other, liquid crystal shutters 61a and 61 b, a synchron- 
ous circuit 62, and color CRT 63 serving as an image 
display device. 

The above first example of a stereoscopic-image 
display system having such a configuration operates 
as follows. The color CRT 63 displays stereoscopic 
images wherein images for right and left eyes are dis- 
played alternately in a time-division fashion. Under 
the control of the synchronous circuit 62, the liquid 
crystal shutter 61a of the glasses 60 is opened and 
thus become transparent only when stereoscopic im- 
ages for the right eye are displayed, and the liquid 
crystal shutter 61b is opened and become transpar- 
ent only when stereoscopic images for the left eye are 
displayed. As a result, an observer wearing the glass- 
es 60 can observe stereoscopic images for the right 
eye with his or her right eye, and stereoscopic images 
for the left eye with the left eye. In this way, stereo- 
scopic vision is provided. 

Figure 2 illustrates the configuration of the sec- 
ond example of a conventional stereoscopic-image 
display system, which includes a lenticular plate 71 
having a large number of stripe-shaped cylindrical 
lenses and a color CRT 72 serving as an image dis- 
play device. 

This second example of stereoscopic- image dis- 
play system having such a configuration operates as 
follows. The color CRT 72 displays simultaneously 
both stereoscopic images for right and left eyes such 
that images for right and left eyes are displayed alter- 
nately on each half-width stripe of the lenticular plate 
71. The right eye of an observer sees only the ster- 



eoscopic images for the right eye displayed on the 
above-described slit-shaped zones through corre- 
sponding cylindrical lenses of the lenticular plate 71, 
and the left eye sees only the stereoscopic images for 

5 the left eye displayed on the slit-shaped zones, 
whereby stereoscopic vision is obtained. 

In the first example of the conventional stereo- 
scopic-image display system, however, an observer 
has to wear troublesome and uncomfortable glasses 

10 which separately provide stereoscopic images to right 
and left eyes of the observer. Another problem in ob- 
serving stereoscopic images using this technique is 
flicker due to the switching between the stereoscopic 
images for right and left eyes. 

is In the second example of the conventional ster- 
eoscopic-image display system, since a stereoscopic 
image is observed via stripe-shaped lenses, stereo- 
scopic vision can be obtained only when an observer 
is in a limited narrow area. If the observer moves, 

20 degradation occurs in the image. Besides, only a few 
observers at various positions can observe an image 
at the same time. Furthermore, image processing is 
required to provide a stripe-shaped image, which 
needs an expensive apparatus. 

25 In medical applications, when an endoscopic op- 
eration is done, an operator observes a plane image 
of the inside of a patient's abdominal cavity displayed 
on a monitor via an endoscope. However, the moni- 
tored image of the inside of the abdominal cavity has 

30 no characteristic features because the entire abdom- 
inal cavity has a single color, and thus it is difficult to 
give perspective vision. This causes a long operation 
time, and gives heavy loads to both operator and pa- 
tient. On the other hand, when a conventional stereo- 

35 scopic-image display system of the above-described 
first or second type is used in the operation, there are 
serious problems in practical use such as uncomfort- 
able glasses for separating right and left images, 
flicker of an image, and limitation in movement of an 

40 observer. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to solve the 
45 above-described problems. 

It is another object of the present invention to pro- 
vide an inexpensive and small-sized image display 
system which can provide different images to right 
and left eyes of an observer without using glasses for 
so separating a right-eye image and left-eye image from 
each other. 

To achieve the objects, the present invention pro- 
vides an image display system for providing first and 
second images such that a right eye and a left eye of 
55 an observer see the first and second images at dif- 
ferent times, respectively, the image display system 
comprising: 

picture-taking means for taking a picture of the 
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observer and then outputting an image of the obser- 
ver; 

a spatial modulation device transparent to 
light, for displaying the first and second images at the 
different times, respectively; 

generation means for generating a pair of back 
light images based on an image output signal from 
the picture-taking means at the different times, re- 
spectively; 

a back-lighting device which receives an out- 
put signal associated with the back light image gen- 
erated by the back light image generation means and 
displays the back light images to illuminate the spatial 
modulation device from a back side thereof, at the dif- 
ferent times; 

synchronization means for synchronizing one 
of the first and second images present on the spatial 
modulation device with a generation of one of the pair 
of back light images by the generation means; and 

an optical element for giving directivity to back 
light emitted by the back-lighting device so that the 
back-lighting device provides backlight illuminations 
of the spatial modulation device for the right and left 
eyes at the different times, wherein 

the generation means comprises: 

image processing means for processing an im- 
age of the observer taken by the picture taking 
means, detecting a contour and/or a centroid of the 
face area of the image of the observer, and then gen- 
erating the pair of back light images on the basis of 
the detected contour and/or centroid. 

Thus constructed apparatus can generate the 
first and second backlight images easily and there- 
fore can display the images in a small size fashion. 

To achieve the above objects, the present inven- 
tion provides another image display system for pro- 
viding first and second images such that a right eye 
and a left eye of an observer see the first and second 
images at different times, respectively, the image dis- 
play system comprising: 

picture-taking means for taking a picture of the 
observer and then outputting an image of the obser- 
ver; 

a spatial modulation device transparent to 
light, for displaying the first and second images at the 
different times, respectively; 

generation means for generating a pair of back 
light images based on an image output signal from 
the picture-taking means at the different times, re- 
spectively; 

a back-lighting device which receives an out- 
put signal associated with the back light image gen- 
erated by the back light image generation means and 
displays the back light images to illuminate the spatial 
modulation device from a back side thereof, at the dif- 
ferent times; 

synchronization means for synchronizing one 
of the first and second images present on the spatial 



modulation device with a generation of one of the pair 
of back light images by the generation means; and 

an optical element for giving directivity to back 
light emitted by the back-lighting device so that the 
5 back-lighting device provides back light illuminations 
of the spatial modulation device for the right and left 
eyes at the different times, wherein 

the picture-taking means comprises: 
a plurality of camera means having different 
w sensitivity characteristics; and 

a plurality of illumination means having char- 
acteristics corresponding to the sensitivity character- 
istics of the plurality of camera means; 

wherein the plurality of camera means and the 
15 plurality of illumination means are disposed in front of 
the plurality of observers in such a manner that they 
are distributed in the direction from the front to the 
back of the plurality of observers. 

The above constructed apparatus, where the ob- 
20 servers are distributed in a wider area, can provide to 
the observers with a vision of the first and second im- 
ages. 

According one aspect of the present invention as 
constructed above, the plurality of illumination means 
25 and the plurality of camera means are distributed in 
the direction from the left to the right as well as in the 
direction from the front to the back of the plurality of 
observers. 

According another aspect of the present inven- 

30 tion as mentioned above, the plurality of camera 
means comprise a plurality of pairs of cameras, and 
the plurality of illumination means comprise a plural- 
ity of pairs of illuminating devices, 

each pair of illuminating devices are distribut- 

35 ed in a transversal direction before the observers, 
and illuminate the observer faces in such a manner 
that a right-side face area and a left-side face area are 
illuminated with light having different wavelengths; 
the plurality of pairs of cameras are distributed 

40 in the transverse and back-and forth directions of the 
observers, each pair of cameras taking a picture of 
said observer's face in such a manner that each said 
camera selectively takes a picture in response to light 
having a corresponding wavelength. 

45 To achieve the above objects, the present inven- 
tion provides a further image display system for pro- 
viding first and second images such that a right eye 
and a left eye of an observer see the first and second 
images at different times, respectively, the image 

so display system comprising: 

picture-taking means for taking a picture of the 
observer and then outputting an image of the obser- 
ver; 

a spatial modulation device transparent to 
55 light, for displaying the first and second images at the 
different times, respectively; 

generation means for generating a pair of back 
light images based on an image output signal from 
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the picture-taking means at the different times, re- 
spectively; 

a back-lighting device which receives an out- 
put signal associated with the back light image gen- 
erated by the back light image generation means and 
displays the back light images to illuminate the spatial 
modulation device from a back side thereof, at the dif- 
ferent times; 

synchronization means for synchronizing one 
of the first and second images present on the spatial 
modulation device with a generation of one of the pair 
of back light images by the generation means; and 

an optical element for giving directivity to back 
light emitted by the back-lighting device so that the 
back-lighting device provides back light illuminations 
of the spatial modulation device for the right and left 
eyes at the different times, wherein 

the generation means comprises: 

means for processing the image of the obser- 
ver taken by said picture-taking means in such a man- 
ner that the positions of bright points associated with 
the image of the observer are detected and then said 
pair of back light images are generated on the basis 
of said detected positions of bright points. 

Since the detected positions of bright points rep- 
resent the position of the observer, thus constructed 
system can provides the first and second images pre- 
cisely. 

To achieve the above objects, the present inven- 
tion provides a further image display system for pro- 
viding first and second images such that a right eye 
and a left eye of an observer see the first and second 
images at different times, respectively, the image dis- 
play system comprising: 

picture-taking means for taking a picture of the 
observer and then outputting an image of the obser- 
ver; 

a spatial modulation device transparent to 
light, for displaying the first and second images at the 
different times, respectively; 

generation means for generating a pair of back 
light images based on an image output signal from 
the picture-taking means at the different times, re- 
spectively; 

a back-lighting device which receives an out- 
put signal associated with the back light image gen- 
erated by the back light image generation means and 
displays the back light images to illuminate the spatial 
modulation device from a back side thereof, at the dif- 
ferent times; 

synchronization means for synchronizing one 
of the first and second images present on the spatial 
modulation device with a generation of one of the pair 
of back light images by the generation means; and 

an optical element for giving directivity to back 
light emitted by the back-lighting device so that the 
back-lighting device provides backlight illuminations 
of the spatial modulation device for the right and left 



eyes at the different times, wherein 

the optical element is a Fresnel lens formed on 
a surface of the spatial modulation device in an inte- 
gral fashion. 

5 The Fresnel lens makes thus constructed display 

system small size. 

According to one aspect of the thus constructed 
system, the Fresnel lens is provided on the back sur- 
face of the spatial modulation device that is closer to 

10 the back-lighting device. 

According to another aspect of the thus con- 
structed system, the spatial modulation device com- 
prises a liquid crystal display device which has a 
glass substrate on a back surface thereof, the glass 

15 which is provided with a pattern of ring bands serving 
as a Fresnel lens. 

To achieve the objects, the present invention pro- 
vides a further image display system for providing 
first and second images such that a right eye and a 

20 left eye of an observer see the first and second im- 
ages at different times, respectively, the image dis- 
play system comprising: 

picture-taking means for taking a picture of the 
observer and then outputting an image of the obser- 

25 ver; 

a spatial modulation device transparent to 
light, for displaying the first and second images at the 
different times, respectively; 

generation means for generating a pair of back 
30 light images based on an image output signal from 
the picture-taking means at the different times, re- 
spectively; 

a back-lighting device which receives an out- 
put signal associated with the back light image gen- 
35 e rated by the back light image generation means and 
displays the back light images to illuminate the spatial 
modulation device from a backside thereof, at the dif- 
ferent times; 

synchronization means for synchronizing one 
40 of the first and second images present on the spatial 
modulation device with a generation of one of the pair 
of back light images by the generation means; and 

an optical element for giving directivity to back 
light emitted by the back-lighting device so that the 
45 back-lighting device provides back light illuminations 
of the spatial modulation device for the right and left 
eyes at the different times, wherein 

the backlight device displays images with two- 
level gradation having a threshold value equal to pre- 
50 determined brightness. 

Where the back-light images are displayed on the 
back-lighting device which can afford two level grada- 
tion display, crosstalk are reduced between the im- 
ages. 

55 According to one aspect of the various display 

systems above described, the generation means gen- 
erates a back light image corresponding to the image 
of the observer's face taken by the picture-taking 
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means. 

According to another aspect of the various dis- 
play systems above described, the picture-taking 
means separates an image of a left-side face area 
and an image of right-side face area from the image s 
of the observer's face, and then displays the image 
of the left-side face area and the image of right-side 
face area on the pair of back-lighting device, respec- 
tively. 

According to further aspect of the various display 10 
systems above described, the picture-taking means 
includes: 

a pair of illuminating devices for illuminating an 
observer face in such a manner that a right-side face 
area and a left-side face area are illuminated with light 15 
having different wavelengths; 

a pair of cameras for taking a picture of the ob- 
server's face in such a manner that each the camera 
selectively takes a picture in response to light having 
the corresponding wavelength. 20 

According to further aspect of the various display 
systems above described, the system further com- 
prises: 

means for determining the difference between 
a pair of image signals associated with the observer 25 
obtained via the pair of cameras, and further remov- 
ing a background image from the pair of image sig- 
nals on the basis of the difference. 

According to a further aspect of the various dis- 
play systems above described, the pair of illuminating 30 
devices are attached to the observer so that the pair 
of illuminating devices move following the movement 
of the head of the observer. 

According to a further aspect of the various dis- 
play systems above described, the pair of cameras 35 
are each provided with a wavelength filter which se- 
lectively passes light emitted by the pair of illuminat- 
ing devices. 

According to a further aspect of the various dis- 
play systems above described, the back lighting de- 40 
vice is disposed outside the focal length of the optical 
element 

According to a further aspect of the various dis- 
play systems above described, the optical element is 
disposed between the spatial modulation device and as 
the back-lighting device. 

According to a further aspect of the various dis- 
play systems above described, the spatial modulation 
device comprises a liquid crystal display device. 

According to a further aspect of the various dis- so 
play systems above described, the spatial modulation 
device inputs image signals representing the first and 
second images taken by an endoscope device; and 
wherein 

the endoscope device includes: 55 
a pair of lens tubes for transmitting images of 
an object to be observed as stereoscopic vision, the 
images of the object being taken at two different vie w- 
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ing angles; and 

a pair of image sensing devices for converting 
the pair of obtained images to corresponding electric 
signals. 

According to a further aspect of the various dis- 
play systems above described, the lens is a convex 
lens, concave mirror or Fresnel lens. 

To achieve the above objects, the present inven- 
tion provides another image display system for pro- 
viding first and second images such that a right eye 
and a left eye of an observer see the first and second 
images at different times, respectively, the image 
display system comprising: 

picture-taking means for taking a picture of the 
observer and then outputting an image of the obser- 
ver; 

generation means for generating a pair of back 
light images based on an image output signal from 
the picture-taking means; 

a spatial modulation device having first and 
second liquid crystal layers transparent to light, for 
displaying the first and second images in a time divi- 
sion fashion; 

a back-lighting device for illuminating the spa- 
tial modulation device from a back side thereof by dis- 
playing the back light images; and 

an optical element, disposed between the spa- 
tial modulation device and the back-lighting device, 
for giving directivity to back light emitted by the back- 
lighting device so that the back-lighting device pro- 
vides back light illuminations of the spatial modula- 
tion device for the right and left eyes, 

wherein the back light images are displayed in 
a time-division fashion in a synchronization with a 
time division display of the spatial modulation device, 
the back light images being displayed at positions 
corresponding to the right and left face areas, respec- 
tively. 

To achieve the above objects, the present inven- 
tion provides another image display system for pro- 
viding first and second images such that a right eye 
and a left eye of an observer see the first and second 
images at different times, respectively, the image 
display system comprising: 

detecting means for detecting a position of the 
observer; 

generation means for generating a pair of back 
light images based on a detected position of the ob- 
server; 

a spatial modulation device having first and 
second liquid crystal layers transparent to light, for 
displaying the first and second images in a time divi- 
sion fashion; 

a back-lighting device for illuminating the spa- 
tial modulation device from a back side thereof by dis- 
playing the back light images; and 

an optical element, disposed between the spa- 
tial modulation device and the back-lighting device, 
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for giving directivity to back light emitted by the back- 
lighting device so that the back-lighting device pro- 
vides back light illuminations of the spatial modulation 
device for the right and left eyes, 

wherein the back light images are displayed in 
a time-division fashion in a synchronization with a 
time division display of the spatial modulation device, 
the back light images being displayed at positions 
corresponding to the right and left face areas, respec- 
tively. 

The time division based display of the target im- 
ages on the spatial modulation device with synchron- 
ization with the display of the back light images elim- 
inates a crosstalk and flickers on the modulation de- 
vice due to slow response of the modulation device. 

Other features and advantages of the present in- 
vention will be apparent from the following descrip- 
tion taken in conjunction with the accompanying 
drawings, in which like reference characters desig- 
nate the same or similar parts throughout the figures 
thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorpo- 
rated in and constitute a part of the specification, il- 
lustrate embodiments of the invention and, together 
with the description, serve to explain the principles of 
the invention. 

Fig. 1 is a schematic diagram illustrating a first 

example of a conventional stereoscopic- image 

display system; 

Fig. 2 is a schematic diagram illustrating a sec- 
ond example of a conventional stereoscopic- im- 
age display system; 

Fig. 3 is a schematic diagram illustrating a first 
embodiment of a stereoscopic- image display 
system according to the present invention; 
Fig. 4 is a schematic diagram illustrating the op- 
eration of the first embodiment of the stereoscop- 
ic-image display system according to the present 
invention; 

Figs. 5Aand 5B are schematic diagrams illustrat- 
ing the operation of the first embodiment of the 
stereoscopic-image display system according to 
the present invention; Fig. 6 is a schematic dia- 
gram illustrating the operation of the first embodi- 
ment of the stereoscopic-image display system 
according to the present invention; 
Fig. 7 is a schematic diagram illustrating a mod- 
ification of the first embodiment in which the 
present invention is applied to an endoscope sys- 
tem; 

Fig. 8 is a schematic diagram illustrating a sec- 
ond embodiment of a stereoscopic-image display 
system according to the present invention; 
Fig. 9 is a functional block diagram illustrating a 
circuit for performing synchronization and image 



processing used in the second embodiment; 
Fig. 10 is a schematic diagram illustrating a third 
embodiment of a stereoscopic-image display 
system according to the present invention; 

5 Fig. 11 is a schematic diagram illustrating an 

fourth embodiment of a stereoscopic- image dis- 
play system according to the present invention; 
Figs. 12 and 13 are schematic diagrams illustrat- 
ing an example of an element used in the fourth 

10 embodiment; 

Figs. 14Aand 14B are schematic diagrams illus- 
trating a modified example of the element shown 
in Figs. 12 and 13; 

Fig. 15 is a schematic diagram illustrating a modi- 
15 fied system of the 1 embodiment shown in Fig. 3; 
Figs. 16A and 16B are schematic diagrams illus- 
trating an example of an element used in modifi- 
cations 1 through 3; 

Fig. 17 is a schematic diagram illustrating a dis- 
20 play system in which a two-layer liquid crystal 

display is applied to the third embodiment of the 
image display system shown in Fig. 10; 
Fig. 18 is a schematic diagram illustrating a dis- 
play system in which a two-layer liquid crystal 
25 display is applied to the fourth embodiment of the 
image display system shown in Fig. 11; 
Fig. 19 is a schematic diagram illustrating a dis- 
play system in which back-lighting devices capa- 
ble of displaying two-level back-light images are 
30 used; and 

Figs. 20A and 20B are schematic diagram illus- 
trating advantages of the back-lighting devices 
capable of displaying two-level back-light im- 
ages. 

35 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Referring to accompanying drawings, display 
40 systems for providing a stereoscopic image accord- 
ing to the present invention will be described below. 

First Embodiment 

45 Fig. 3 illustrates the construction of the first em- 
bodiment of the stereoscopic-image display system 
according to the present invention. 

As shown in Fig. 3, the system includes: a trans- 
mission-type of liquid crystal display 10 serving as a 

so spatial modulation device; a Fresnel lens 11, serving 
as an optical element, having a focal length of 1 50 mm 
disposed at the back of the spatial modulation device 
10; a black-and-white CRT 12 serving as a back- 
lighting device which emits light corresponding to ob- 

55 servers' images wherein the black-and-white CRT 1 2 
is disposed opposite to the spatial modulation device 
10 via the lens 11 at a position 160 mm far from the 
lens 11 which is longer than the focal length of the 
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lens 11 ; a CCD camera 14 serving as a picture-taking 
apparatus; an image processing unit 402 for produc- 
ing images approximating images of right-side and 
left-side areas of the observer's face from the image 
of the observer taken by the camera 14; and a syn- s 
chronous circuit 401 for synchronizing the above- 
described images provided by the image processing 
unit 13 with right-eye and left-eye target images pro- 
vided by a stereoscopic image output device 400. In 
Fig. 3, there are also shown observers 16 and 17 who 10 
observe a stereoscopic image. 

Fig. 4 and Figs. 5A, 5B illustrate how images of 
observers 1 6 and 1 7 taken by the CCD camera 1 4 are 
processed by the image processing unit 42. 

If light emitted from a light source (not shown) is is 
projected only onto faces of observers, then an image 
obtained by the camera 14 consists mainly of the 
faces of the observers. In Fig. 4, reference numerals 
20 and 21 denote contours of observers. The image 
processing unit 402 performs edge-extraction proc- 20 
essing on the image signal output by the camera 14 
(using for example a Laplacian filter) so as to extract 
its edge. 

The image processing unit 402 calculates areas 
of regions surrounded by contours 20 and 21 , respec- 25 
tivety, and further determines the center of area as- 
sociated with each region (face region) surrounded by 
contours 20 and 21 . the obtained positions of the area 
centers of the respective regions surrounded by con- 
tours 20 and 21, respectively, are denoted by refer- 30 
ence numerals 22 and 23 in Fig. 4. 

In Fig. 5A, reference numerals 30 and 31 denote 
images corresponding to right-side areas of face re- 
gions surrounded by contours 20 and 21, respective- 
ly, wherein these images 30 and 31 are produced 35 
based on centers of areas 22 and 23, respectively: 

Simitarly, reference numerals 32 and 33 in Fig. 
5B denote images corresponding to left-side areas of 
face regions produced based on centers of areas 22 
and 23. In the above processing, shapes of observers 40 
faces are known. Images 30, 31 , 32, and 33 are pro- 
duced from an image having a shape similar to that 
of a human face which has been prepared beforehand 
and is stored in the image processing unit 402. After 
determining each position of the center of area, the 45 
image processing unit 402 produces images in such 
a manner that the determined positions become cen- 
ters of respective images. 

In Fig. 6, observers see virtual images extracted 
from their own faces according to the first em bod i- 50 
ment shown in Fig. 3. For simplicity, only a back- 
lighting device (a black-and-white CRT) and a lens 
are shown, and the other elements such as a liquid 
crystal display, picture-taking apparatus, image proc- 
essing unit, etc. are not shown in Fig. 6. In this Fig. 6, 55 
reference numerals 11 denotes a lens; 12 denotes a 
black-and-white CRT; 16 and 17 denote two obser- 
vers who are observing a stereoscopic image; and 



40, 41, 42, and 43 denote areas of observers' images 
displayed on the black-and-white CRT 12 wherein 
these areas are actually seen by the observers. 

The operation of the stereoscopic-image display 
system constructed in the above-described manner 
will be explained referring to Figs. 3 through 6. 

In Fig. 3, signals associated with right-eye and 
left-eye images are output by the stereoscopic image 
output device such as video tape recorder, laser disk 
player, or a pair of television cameras to the liquid 
crystal display 10. The liquid crystal display 10 then 
displays right-eye and left-eye images alternately in 
a time-sharing fashion so as to form a stereoscopic 
image. In this time-sharing display of images, it is pre- 
ferable that images be displayed alternately at a rate 
of 20-60 frames per second. If the display rate is less 
than 20 frames per second, flicker appears in images 
to a degree unsuitable for observation. On the other 
hand, if the display rate is greater than 60 frames per 
second, the liquid crystal display 10 cannot respond 
at such a high rate, and therefore crosstalk occurs be- 
tween images for the right and left eyes in which the 
left eye (right eye) can see the image for the right-eye 
(left-eye). 

The CCD camera 14 takes a picture of observers 
seen from the front side. An image signal obtained is 
applied to the image processing unit 42. The image 
processing unit 42 extracts contours 20, 21 of obser- 
vers' faces as shown in Fig. 5, and then detects the 
centroids 22 and 23 of regions surrounded by these 
contours 20 and 21 , respectively. The image process- 
ing unit 42 further divides each face contour 20, 21 
into right and left areas employing each centroid 22, 
23 as the symmetry center, and 
produces half-face images 30, 31, 32, and 33 as 
shown in Figs. 5Aand 5B. The right half-face images 
30, 31 and the left half-face images 32, 33 are alter- 
nately displayed with high brightness in a time- 
sharing fashion and in a upside-down fashion on the 
black-and-white CRT 12. 

As described above, both liquid crystal display 10 
and black-and-white CRT 12 display right-eye and 
left-eye images alternately in a time-sharing fashion, 
wherein synchronization between these displaying 
processes is accomplished by the synchronous cir- 
cuit 41. 

Referring to Fig. 6, the function of the Fresnel 
lens 11 will be described below. The Fresnel lens 11a 
is disposed at a location which allows observers 16 
and 17 to see virtual images of themselves displayed 
in an upside-down fashion on the black-and-white 
CRT 12a, wherein the black-and-white CRT 12 is 
placed at a location outside the focal length of the 
Fresnel lens 11 so that right eyes of each observer 
can see separately only the right-eye and left-eye 
areas 40, 41 , respectively, of the screen of the black- 
and-white CRT 12, and wherein these areas 40-43 
may also be enlarged within the limitation determined 
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by the effective diameter of the Fresnel lens 11 . With 
this arrangement, when the images 40 and 42 having 
shapes similar to those of right half faces of observers 
1 6 and 17 are displayed as illuminating portion, these 
images 40 and 42 having shapes similar to those of 
right half faces of observers 16 and 17 act as selec- 
tive light sources each having a diameter equal to the 
effective diameter of the Fresnel lens 11, which act 
only for the right eyes of the observers 16 and 17. 
When the areas 40 and 42 are displayed, the areas 
corresponding to the left half faces of observers 16 
and 17 are not displayed. Therefore, the left eyes do 
not receive the light emitted by the black-and-white 
CRT 12. Similarly, when the images 41 and 43 having 
shapes similar to those of left half faces are displayed 
as illuminating portion, these images 41 and 43 act as 
selective light sources each having a diameter equal 
to the effective diameter of the Fresnel lens 11 , which 
act only for the left eyes of the observers 16 and 17. 
When these areas 41 and 43 are displayed, the areas 
corresponding to the right half faces are not dis- 
played. Therefore, the right eyes do not receive the 
light emitted by the black-and-white CRT 12. 

According to the above-described function of the 
system of the first embodiment, the right-eye image 
or the image for right eyes displayed on the liquid 
crystal display 10 as shown in Fig. 3 is illuminated 
from its back side so that the right-eye image can be 
seen only by right eyes of observers 16 and 17, and 
the left-eye i mage or the image for left eyes displayed 
on the liquid crystal display 10 is illuminated from its 
back side so that the left-eye image can be seen only 
by left eyes of the observers 16 and 17. As a result, 
observers 16 and 17 can a pair of images forming a 
stereoscopic image at the same time. In this way, the 
system of the present invention provides stereoscop- 
ic vision to both observers 16 and 17 at the same 
time. Even if the observer 16 or 17 moves, the ster- 
eoscopic vision is still provided as long as the obser- 
ver is in a region which allows the CCD camera 14 to 
take a picture of the observer. 

Application of the first Embodiment to an 
Endoscope 

Fig. 7 illustrates the construction of the first em- 
bodiment of a stereoscopic-image display system ap- 
plied to an endoscope. As shown in Fig. 7, the system 
includes: objective lenses 50a and 50b for taking pic- 
tures of an object; lens tubes 51a and 51b having opt- 
ical systems for transmitting the above obtained im- 
ages wherein these lens tubes 51a and 51b are dis- 
posed at an angle corresponding to a convergence 
angle of observer's eyes; CCD cameras 52a and 52b; 
and a stereoscopic-image display system 53 descri- 
bed above in connection with Fig. 3. 

The endoscope system constructed in the above- 
described manner operates as follows. Two images of 



an object taken via objective lenses 50a and 50b are 
transmitted through lens tunes 51a and 51b having 
the convergence angle adjusted for stereoscopic vi- 
sion so as to form an image for right eyes and an im- 

5 age for left eyes on CCD cameras 52a and 52b, re- 
spectively, thereby providing stereoscopic vision in 
the endoscope. The above-described two images are 
applied to the stereo-scopic image output apparatus 
400 (see Fig. 3), where the images are converted into 

10 time-division control signals, and are displayed on 
the liquid crystal display 10, thus providing a stereo- 
scopic vision associated with the image taken by the 
above endoscope to a large number of observers ac- 
cording to functions of the stereoscopic-image dis- 

15 play system 53 as described above in connection with 
the first embodiment. 

Image sensing devices 52a and 52b in this em- 
bodiment of the present invention may also be dis- 
posed adjacent to the objective lenses 50a and 50b, 

20 respectively, so that electric signals representing im- 
ages are produced by these image sensing devices 
and then transmitted through the lens tubes 51a and 
51b, whereby it becomes possible to freely select the 
shapes of lens tubes more suitable for a specific ap- 

25 plication. 

Second Embodiment 

Fig. 8 illustrates a second embodiment of a ster- 

30 eosco pic-image display system according to the 
present invention. This embodiment has the following 
characteristic features. Images of observers are ob- 
tained via an observer's-image taking unit 200. Im- 
ages of right-side face areas of observers #1-#3 and 

35 images of left-side face areas are alternately dis- 
played on a black-and-white CRT 12. In synchronism 
with the displaying operation of these images, a spa- 
tial modulation device 10 is driven alternately by an 
image for right eye and an image for left eye in a time- 

40 sharing fashion thereby providing a stereoscopic im- 
age to observers. 

As shown in Fig. 8, the system of this embodi- 
ment includes a transmission-type liquid crystal dis- 
play 10 serving as a spatial modulation device. The 

45 system further includes: a Fresnel lens 11, serving as 
optical element, having a focal length of 150 mm dis- 
posed at the back of the spatial modulation device 1 0; 
a black-and-white CRT 12 serving as a back-lighting 
device which emits light corresponding to obser- 

50 vers' images wherein the black-and-white CRT 12 is 
disposed opposite to the spatial modulation device 1 0 
via the lens 1 1 at a position 1 60 mm far from the lens 
1 1 ; a circuit 21 0 for performing synchronization proc- 
essing and image processing; and a stereoscopic irrv 

55 age output device 220. 

The device 200 includes LED light sources 13a, 
13b, 13c, and 13d serving as illuminating light sourc- 
es for emitting light having wavelengths 900 nm, 850 



8 



15 



EP0 656 730 A1 



16 



nm, 950 nm, and 800 nm, respectively; and black- 
and-white CCD cameras 14a, 14b, 14c, and ^serv- 
ing as apparatus for taking pictures. 

In this arrangement, LED 13a and LED 13b main- 
ly illuminate observers #1 and #2 near the system, 5 
and LED 1 3c and LED 1 3d mainly illuminate an obser- 
ver #3 at a rear position. The CCD cameras 14a, 14b, 
14c, and 14d are attached with wavelength filters 
having wavelengths 900 ± 10 nm, 850 ± 10 nm, 950 
±10 nm, and 800 ±10 nm, respectively, so that they 10 
can take pictures of only observers' faces illuminated 
with LEDs 13a, 13b, 13c, and 13d, respectively. Video 
signals associated with the face images of observers 
#1 , #2, and #3 are applied to the signal processing cir- 
cuit 210. 15 

Referring to Fig. 8, the LED light source 13a illu- 
minates the right-side face areas of the observers #1 
and #2, and images of these right-side face areas are 
obtained via the CCD camera 14a. The LED light 
source 13b illuminates the left-side face areas of the 20 
observers #1 and #2, and images of these left-side 
face areas are obtained via the CCD camera 14b. 
Similarly, the LED light source 13c illuminates the 
right-side face area of the observer #3, and the image 
of this right-side face area is obtained via the CCD 25 
camera 14c. Furthermore, the LED light source 13d 
illuminates the left-side face area of the observer #3, 
and the image of this left-side face area is obtained 
via the CCD camera 14d. The obtained images of 
right and left-side face areas of observers are applied 30 
to the signal processing circuit 21 0. 

As can be seen from this specific example, a 
plurality of LEDs are disposed in the direction from 
the front to the rear so that approximately equal illu- 
mination is provided to plural observers occupying 35 
various positions in the direction from the front to the 
rear. Therefore, observers can move within a wide 
area, and a great number of people can be observers. 

In this second embodiment in which four LEDs 
(13a- 13d) having different wave-length bands are 40 
used, there are provided four picture-taking appara- 
tus (14a-14d) having characteristics corresponding to 
those of these LEDs. However, if one camera which 
can separate a plurality of wave-length bands and 
can take corresponding pictures is available, only this 45 
single camera is enough to do all required functions. 

Figure 9 is afunctional block diagram of the proc- 
essing circuit 210. In Figure 9, the signal processing 
circuits 80a and 80b produce images of observers 
based on right-side face area images 14a and 14c so 
and left-side face area images 14b and 14d output by 
the observer's-image taking unit 200. The stereo- 
scopic image output device 220 provides an image 
222 for right eyes and an image 224 for left eyes to a 
time-division multiplexing circuit 212. The time- 55 
division multiplexing circuit 212 also receives output 
signals from the signal processing circuit 80a and 
80b. The time-division multiplexing circuit 212 selects 



the right-side face area image 80a so that it is dis- 
played as back light on the black-and-white CRT 12. 
At the same time, the time-division multiplexing cir- 
cuit 212 selects the image 222 for right eyes and 
transfers it to the spatial modulation device 10. Then, 
the time-division multiplexing circuit 212 selects the 
left-side face area image 80b so that it is displayed as 
back light on the black-and-white CRT 12, and at the 
same time selects the image 224 for right eyes and 
transfers it to the spatial modulation device 10. In this 
way, a stereoscopic image is provided to each obser- 
ver. 

Furthermore, the technique of differential proc- 
essing associated with right-side and left-side face 
areas described above in connection with the first 
embodiment may also be applied to this seventh em- 
bodiment 

Further, the technique of the second embodiment 
can be applied to an endoscope. 

Third Embodiment 

Fig. 10 illustrates the construction of the third 
embodiment of a stereoscopic-image display system, 
including: a transmission-type liquid crystal display 
10 serving as a spatial modulation device; a Fresnel 
lens 11, serving as optical element, having a focal 
length of 150 mm disposed at the back of the spatial 
modulation device 10; a black-and-white CRT 12 
serving asan illuminating image display device which 
emits light for illumination, wherein the black-and- 
white CRT 12 is disposed opposite to the spatial mod- 
ulation device 1 0 via the lens 1 1 at a position 1 60 mm 
far from the lens 11; 

an LED light source 13 serving as an illuminating light 
source of wavelength of 850 nm; and a black-and- 
white CCD camera 14 serving as a picture-taking ap- 
paratus. In Fig. 10, there are also shown observers 
16 and 17 who observe a stereoscopic image. Fur- 
thermore, the system also includes: an image output 
device 81 ; and a bright-point coordinate detector 82 
for detecting pixels or bright points of images which 
are obtained via the black-and-white CCD camera 14 
and displayed on a black-and-white liquid crystal dis- 
play 83. Based on these position's coordinates, im- 
ages 44a and 44b are displayed on the black-and- 
white CRT 12 so that these images act as back-light 
illuminating an image viewed by right eyes of the ob- 
servers 16 and 17, and images 45a and 45b are dis- 
played on the black-and-white CRT 12 so that these 
images act as back-light illuminating an image 
viewed by left eyes of the observers 16 and 17. 

The entire faces of the observers are illuminated 
from the front side with an infrared LED 13. Face im- 
ages of the observers are obtained via the black-and- 
white CCD camera 14 provided with a wavelength fil- 
ter corresponding to the wavelength of the LED 13. 
The output of the black-and-white CCD camera 14 is 
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connected to black-and-white liquid crystal display 83 
so that the face images of the observers are dis- 
played as bright points on the black-and-white liquid 
crystal display 83. 

A two-dimensional position sensor (bright-point 
coordinate detector ) 82 for detecting coordinates of 
bright points is disposed at the front of the panel of the 
black-and-white liquid crystal display 83. The position 
coordinates of observers' face images displayed on 
the black-and-white liquid crystal display 83 are de- 
tected in real time by the two-dimensional position 
sensor 82, and sent to the image output device 81 . 

Based on the number and coordinates of face im- 
ages detected by the two-dimensional position sen- 
sor (bright-point coordinate detector ) 82, the image 
output device 81 outputs specific images acting as 
back-lighting devices to the black-and-white CRT 12. 

Furthermore, the system also includes: a black- 
and-white liquid crystal display 83 for displaying face 
images obtained via the black-and-white CCD cam- 
era 14; and a bright-point coordinate detector 82 for 
detecting pixels or bright points forming the image 
displayed on the black-and-white liquid crystal dis- 
play 83. The detected position coordinates of the 
bright points are transferred to an image output de- 
vice 81. These bright points act as measures indicat- 
ing positions of observers and their face sizes. The 
image processing unit 81 determines face sizes of ob- 
servers from the number of bright points detected by 
the detector 82, and determines right-eye images as 
well as left-eye images having sizes corresponding to 
the above face sizes. These images have been pre- 
pared beforehand and are stored in the image proc- 
essing unit 81. 

Face images of the observers 16 and 17 obtained 
via the camera 14 are displayed on the black-and- 
white liquid crystal display 83 as described above. 
The bright-point coordinate detector 82 detects the 
position coordinates of these images as bright points, 
and transfers the results to the image output device 
81. Then, these are displayed on the black-and-white 
CRT 12 as images 44a and 44b acting as back- 
lighting devices for right eyes of the observers 16 and 
17. Furthermore, portions acting as the back-lighting 
devices 45a and 45b for the left eyes of the observers 
16 and 17 are displayed on the black-and-white CRT 
12 wherein the image output device 81 determines 
whether the positions of these images correspond to 
right eyes or left eyes. In the above displaying proc- 
essing, the synchronous circuit 84 performs syn- 
chronization between target images displayed on the 
spatial modulation device 10 and images (back-light) 
for right and left eyes displayed on the black-and- 
white CRT 12. As for the light source and camera, the 
system of this tenth embodiment needs only one light 
source and one camera. 

The shapes and sizes of the specific images 44a 
and 45b are optimized such that these images can 



serve as back-lighting devices which allow the obser- 
vers 16 and 17 to correctly discriminate a right image 
from a left image. The black-and-white liquid crystal 
display 83 may be replaced with a CRT, plasma dis- 
5 play, or LEDs arranged in a matrix fashion. 

Fourth Embodiment 

In any of the first through third embodiments, the 

10 Fresnel lens 11 is separate from the liquid crystal dis- 
play device 10. In contrast, in a fourth embodiment 
described below, a Fresnel lens and a liquid crystal 
display device are formed in an integral fashion there- 
by achieving a reduction in the system size. 

15 Referring to Fig. 11 , the fourth embodiment of the 

present invention will be described below. 

The system has a transmission-type liquid crys- 
tal display 110 a back surface of which a Fresnel lens 
111 is integrally provided, whose focal length is 150 

20 mm. The system further includes: ultrasonic wave 
generators 27a and 27b for generating ultrasonic 
waves having frequencies of 100 kHz and 120 kHz, 
respectively, toward observers 16 and 17; ultrasonic 
wave detectors 28a and 28b for detecting ultrasonic 

25 waves generated by the ultrasonic wave generators 
wherein the ultrasonic wave detector 28a selectively 
detects only an ultrasonic wave having a frequency 
corresponding to that of the ultrasonic wave genera- 
tor 27a, and the ultrasonic wave detector 28b selec- 

30 tively detects only an ultrasonic wave having a fre- 
quency corresponding to that of the ultrasonic wave 
generator 27b; and an ultrasonic wave image output 
device 29. In Fig. 11, reference numerals 44a, 44b, 
45a, and 45b denote images corresponding to right- 

35 side face areas and left-side face areas of observers 
16 and 17 displayed on the black-and-white CRT 12 
wherein these areas are such areas of the black-and- 
white CRT 12 which emit light for back-light illumina- 
tion. 

40 The ultrasonic wave image output device 29 per- 
forms control so that the spatial modulation device 1 0 
is driven by a video signal for the right-side face areas 
when images 44a and 44b corresponding to the right- 
side face areas are displayed on the black-and-white 

45 CRT. That is, when back-light images corresponding 
to right-side face areas are displayed on the black- 
and-white CRT, the synchronous circuit allows an im- 
age for right eyes to be displayed on the spatial mod- 
ulation device 10, and when the back-light images are 

so changed to images (45a, 45b) corresponding to left- 
side face areas, the synchronous circuit changes the 
image displayed on the spatial modulation device 10 
to an image for left eyes. 

In the fourth system, two ultrasonic waves having 

55 different wavelengths generated by the ultrasonic 
wave generators 27a and 27b are reflected from two 
observers, and detected by the ultrasonic wave de- 
tectors 28a and 28b, respectively. From the detected 
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signals, the ultrasonic wave image output device 29 
calculates the positions of images corresponding to 
right-side and left-side face areas of the observers to 
be displayed on the black-and-white CRTs 12a and 
12b, and then outputs predetermined images for s 
right-side faces and images for left-side faces to the 
black-and-white CRT 12, so as to display these im- 
ages on the black-and-white CRT 12. In this process- 
ing, it is easy to display only images corresponding to 
observers' faces on the black-and-white CRT 12 and 10 
display nothing other than those images. Therefore, 
it is possible to prevent crosstalk between right and 
left images in which the left eye (right eye) gets weak 
perception of the right-eye (left-eye) image due to dis- 
turbance in light is 

In Fig. 11, the spatial modulation device (LCD) 
110 has the Fresnel lens 111 on the back side. Many 
variations of a combination of a liquid crystal device 
and a Fresnel lens may be possible. Some examples 
of such variations will be described below. 20 

Fig. 12 is a perspective view illustrating the entire 
appearance of a display device comprising a liquid 
crystal device 200 and a Fresnel lens 201 looking like 
circular bands wherein the Fresnel tens 201 is bonded 
to the liquid crystal device 200. Fig. 13 is a cross- 25 
sectional view illustrating the structure of the display 
device in which the Fresnel lens 201 is bonded to the 
back face of the liquid crystal device 200. 

As shown in Fig. 1 3, polarizing filters 202 and 209 
for polarizing light are disposed at the most outer 30 
sides of the liquid crystal device 200 so that optical 
properties of the liquid crystal can be used in conjunc- 
tion with the polarizing filters 202 and 209. Glass sub- 
strates 203 and 208 for encapsulating the liquid crys- 
tal are disposed inside the polarizing filters 202 and 35 
209. Inside the glass substrates, a glass filter 204 is 
disposed as required. At further inner positions, 
transparent electrodes 205 and 206 for applying a re- 
quired electric field to the liquid crystal are disposed 
wherein the liquid crystal 206 is disposed between 40 
these transparent electrodes 205 and 206. If a Fres- 
nel lens 201 is bonded to the liquid crystal device 200 
constructed in the above-described manner, then a 
structure whose cross section is shown in Fig. 13 is 
obtained. 45 

In this structure in which the Fresnel lens 201 is 
bonded to the back face of the liquid crystal device 
200, the space and holder required for installing the 
lens become unnecessary. Furthermore, this struc- 
ture leads to a reduction in the total system size. 50 

Fig. 14A illustrates another example in which a 
circular band pattern similar to that shown in Fig. 12 
is formed in an integral fashion on a glass substrate 
disposed at the most outer position. As shown in Fig. 
14B, this liquid crystal device also has polarizing fil- 55 
ters 202 and 209 for polarizing light such that optical 
properties of the liquid crystal can be used in conjunc- 
tion with the polarizing filters 202 and 209. However, 



as for the side on which the circular band pattern is 
formed, the glass substrate 208 is disposed at the 
most outer position, and the polarizing filter 209 is dis- 
posed next to the glass substrate 208. Therefore, one 
of two glass substrates used to encapsulate the liquid 
crystal is disposed next to the most outer layer. At fur- 
ther inner positions, transparent electrodes 205 and 
206 for applying a required electric field to the liquid 
crystal are disposed wherein the liquid crystal 206 is 
disposed between these transparent electrodes 205 
and 206. A Fresnel lens 201 is bonded to the liquid 
crystal device 200 constructed in the above- 
described manner, and thus a structure whose cross 
section is shown in Fig. 13 is complete. 

The circular band pattern can be formed by per- 
forming etching directly on a glass plate, or by forming 
a pattern in a resin layer coated on the outer resin sur- 
face of the liquid crystal by means of compression- 
patter n-t ransf erring . 

Modifications of Time-Division Control 

There will be shown below three examples of dis- 
play systems in which modified time-division control 
techniques similar to those used in the embodiments 
described in connection with Fig. 3-11. 

Modification 1 

Fig. 15 illustrates a modification of the first em- 
bodiment described above in connection with Fig. 3. 

As shown in Fig. 15, this modified system in- 
cludes: a transmission-type liquid crystal display 110 
serving as a spatial modulation device which com- 
prises a first liquid crystal layer 11 0a and a second liq- 
uid crystal layer 110b placed on the first liquid crystal 
layer 110a via an insulating layer; Fresnel lens 11, 
serving as optical element, having a focal length of 
150 mm disposed at the back of the spatial modula- 
tion devices 110a and 110b; a black-and-white CRT 
12 serving as a back-lighting device for emitting light 
corresponding to images associated with observers, 
wherein the black-and-white CRT 12 is disposed op- 
posite to the spatial modulation devices 110a and 
1 1 0b via the lens 11 at a position 1 60 mm far from the 
lens 11; LED light sources 13a and 13b serving as il- 
luminating light sources which emit light having wave- 
lengths 850 nm and 950 nm, respectively; and black- 
and-white CCD cameras 14a and 14b serving as ap- 
paratus for taking pictures. In Fig. 15, there are also 
shown observers 16 and 17 who observe a stereo- 
scopic image. Numeral 19 denotes an image proc- 
essing apparatus. 

In this modification 1, video signals associated 
with face images of observers 16 and 17 obtained 
separately via cameras 14a and 14b are applied to the 
image processing unit 19. The image processing unit 
19 detects the positions corresponding to right-side 
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face areas and left-side face areas from the above 
video signal, and alternatively displays two back-light 
images on the CRT 12 at positions corresponding to 
the detected two positions so that these two back- 
light images can function as illumination sources 
which allow the observers 16 and 1 7 to correctly dis- 
criminate a right image from a left image. These 
back-light images illuminate the spatial modulation 
device 110 as follows. The image processing unit 19 
alternately displays an image to be viewed by right 
eyes on the first liquid crystal layer 110a and an im- 
age to be viewed by left eyes on the second liquid 
crystal layer 110b, and provides output signals asso- 
ciated with the right-side face areas or the left-side 
face areas to the CRT in synchronism with the above 
images to be viewed by right or left eyes under the 
control of the synchronous circuit 84. 

Thus, displaying the target images for the right 
and left eyes on the LCD 110 in a time-division fash- 
ion provides the reduction of after image phenomen- 
on for each display on the LCD. In this way, a stereo- 
scopic image is provided to observers via the liquid 
crystal layer. 

Referring to Figs. 33Aand 33B, there will be ex- 
plained below the structure of the transmission-type 
liquid crystal display 110 serving as the spatial mod- 
ulation device comprising the first liquid crystal layer 
110a and the second liquid crystal layer 110b placed 
on the first liquid crystal layer 11 0a via the insulating 
layer. 

Fig. 16A is a perspective view illustrating the en- 
tire appearance of the liquid crystal display 110, in 
which reference numerals 110a and 110b denote the 
first and second liquid crystal layers, respectively. 
Reference numeral 201 denotes the insulating layer 
providing electric isolation between electrodes 
formed on the above-described two liquid crystal lay- 
ers. 

Fig. 16B is a cross-sectional view of the liquid 
crystal display 110. In the first liquid crystal layer, as 
shown in Fig. 16B, a polarizing filter 202 which polar- 
izes light so that optical properties of the liquid crystal 
can be used is disposed at the most outer position, a 
glass substrate 203 for encapsulating the liquid crys- 
tal is disposed inside the polarizing filters 202 and 
209, and a color filter 204 is disposed under the glass 
substrate 203 as required. Inside the color filter 204, 
the liquid crystal 206 is disposed between transpar- 
ent electrodes 205 and 207. 

The second liquid crystal layer 110b is disposed 
next to the first liquid crystal layer 110a via an insu- 
lating layer 208. In the second liquid crystal layer 
110b, a liquid crystal 210 is disposed next to the in- 
sulating layer 206 between transparent electrodes 
209 and 211 , and a glass substrate 212 for encapsu- 
lating the liquid crystal 210 is disposed next to the liq- 
uid crystal 210. Furthermore, a polarizing filter 21 3 is 
disposed at the most outer position. That is, the first 



liquid crystal layer is composed of elements from the 
polarizing filter 202 through the transparent electrode 
207, and the second liquid crystal layer 110b com- 
posed of elements from the transparent electrode 
s 209 through the polarizing filter 213 is disposed ad- 
jacent to the first liquid crystal layer via the insulating 
layer 208. 

The liquid crystal display of the two-layer type 
described here in modification 1 is suitable for use in 
10 a system in which images are displayed on a single 
liquid crystal device. 

Modification 2 

15 Fig. 17 illustrates the construction of a modified 

display system in which the above two-layer liquid 
crystal display is applied to the image display system 
of the embodiment described in connection with Fig. 
10. 

20 As shown in Fig. 17, the system includes: a trans- 

mission-type liquid crystal display 110 serving as a 
spatial modulation device comprising a first liquid 
crystal layer 110a and a second liquid crystal layer 
110b placed on the first liquid crystal layer 110a via 

25 an insulating layer; a Fresnel lens 11, serving as opt- 
ical element, having a focal length of 150 mm dis- 
posed at the back of the spatial modulation device 
110; a black-and-white CRT 12 serving as an illumin- 
ating image display device which emits light for illu- 

30 mination, wherein the black-and-white CRT 12 is dis- 
posed opposite to the spatial modulation devices 110 
via the lens 11 ataposition 160 mm far from the lens 
11; an LED light source 13 serving as an illuminating 
light source of wavelength of 850 nm; and a black- 

35 and-white CCD camera 14 serving as a picture-taking 
apparatus. In Fig. 17, there are also shown observers 
16 and 17 who observe a stereoscopic image. The 
system further includes: an image processing unit 
19'; and a bright-point coordinate detector 82 which 

40 detects pixels or bright-point coordinates of face im- 
ages which are obtained via the black-and-white CCD 
camera 14 and displayed on a black-and-white liquid 
crystal display 83, and sends detected bright-point 
coordinates to the image processing unit 19'. In Fig. 

45 1 7, areas 44a and 44b on the screen of the black-and- 
white CRT 12 are back-light images displayed on the 
black-and-white CRT 12 wherein these back-light im- 
ages illuminate an image to be viewed by right eyes 
of observers 16 and 17, that is, these areas 44a and 

so 44b are light emitting areas of the black-and-white 
CRT 12. Similarly, areas 45a and 45b on the screen 
of the black-and-white CRT 12 are back-light images 
displayed on the black-and-white CRT 12 wherein 
these back-light images illuminate an image to be 

55 viewed by left eyes of observers 16 and 1 7. Video sig- 
nals of face images of the observers 16 and 17 ob- 
tained via the camera 14 are displayed on the black- 
and-white liquid crystal display 83 as described 

12 
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above. The bright-point coordinate detector 82 de- 
tects the bright points of these image. The detected 
positions of the bright points are input to the image 
processing unit 19*. The image processing unit 
1 9* then determines image sizes and positions on the 
black-and-white CRT 12 at which the image to be dis- 
played. Thus, the images 44a and 44b acting as back- 
light for right eyes of the observers 16and 17are dis- 
played on the CRT as shown in Fig. 17. Subsequent- 
ly, back-light images for left eyes of the observers 16 
and 17 are displayed. That is, the image processing 
unit 19* determines whether the positions correspond 
to right eyes or left eyes, and back-light images 45a 
and 45b are displayed on the black-and-white CRT 
according to the determination result. In the above 
displaying processing, the synchronous circuit 84 
performs synchronization between an image dis- 
played on the spatial modulation device and (back- 
light) images for right and left eyes displayed on the 
black-and-white CRT 12. As for the light source and 
camera, the system needs only one light source and 
one camera. Furthermore, in this system, unlike the 
first embodiment described earlier, only one black- 
and-white CRT, one Fresnel lens, and one spatial 
modulation device are used, and a half mirror for pro- 
ducing a composite image is not necessary. 

Modification 3 

Fig. 18 illustrates the construction of a third 
modified display system in which the above two-layer 
liquid crystal display is applied to the image display 
system of the embodiment described in connection 
with Fig. 10 (in which observers 1 positions are detect- 
ed using ultrasonic waves). 

As shown in Fig. 18, the system includes: ultra- 
sonic wave generators 27a and 27b for generating ul- 
trasonic waves having frequencies of 100 kHz and 
120 kHz, respectively, toward observers 16 and 17; 
ultrasonic wave detectors 28a and 28b for detecting 
ultrasonic waves generated by the ultrasonic wave 
generators wherein the ultrasonic wave detector 28a 
selectively detects only an ultrasonic wave having a 
frequency corresponding to that of the ultrasonic 
wave generator 27a, and the ultrasonic wave detector 
28b selectively detects only an ultrasonic wave hav- 
ing a frequency corresponding to that of the ultrason- 
ic wave generator 27b; and an ultrasonic wave image 
output device 29. In Fig. 18, reference numerals 44a, 
44b, 45a, and 45b denote images corresponding to 
right-side face areas and left-side face areas of ob- 
servers 16 and 17 displayed on the black-and-white 
CRT 12 wherein these areas are such areas of the 
black-and-white CRT 12 which emit light for back-light 
illumination. 

The ultrasonic wave image output device 29 per- 
forms control so that the spatial modulation device 
110 is driven by a video signal for the right-side face 



areas when images 44a and 44b corresponding to the 
right-side face areas are displayed on the black-and- 
white CRT. That is, when back-light images 44a and 
44b are displayed on the black-and-white CRT, the 

5 synchronous circuit 84 allows an image for right eyes 
to be displayed on the spatial modulation device 110, 
and when the back-light images are changed to im- 
ages (graphics) 45a, 45b, the synchronous circuit 
changes the image displayed on the spatial modula- 
te tion device 110 to an image for left eyes. 

In this third modified system, two ultrasonic 
waves having different frequencies generated by the 
ultrasonic wave generators 27a and 27b are reflected 
from two observers, and detected by the ultrasonic 

15 wave detectors 28a and 28b, respectively. From the 
detected signals, the ultrasonic wave image output 
device 29 calculates the positions of images corre- 
sponding to right-side and left-side face areas of the 
observers to be displayed on the black-and-white 

20 CRTs 12a and 12b, and then outputs predetermined 
images for right-side faces and images for left-side 
faces to the black-and-white CRT 12, so as to display 
these images on the black-and-white CRT 12. In this 
processing, it is easy to display only images corre- 

25 spending to observers' faces on the black-and-white 
CRT 12 and display nothing other than those images. 
Therefore, it is possible to prevent crosstalk between 
right and left images in which the left eye (right eye) 
gets weak perception of the right-eye (left-eye) image 

30 due to disturbance in light. 

In the three modifications described above, the 
techniques described earlier such as the technique of 
performing differential processing between right- 
side and left-side face images displayed on back- 

35 lighting devices, and the technique in which half-face 
images of observers are taken using only one CCD 
camera, and then this half-face images are displayed 
on one of back-lighting devices, and negative-to-pos- 
itive inverted images of the above half-face images 

40 are displayed on the other back-lighting device, may 
also be employed. 

Modifications of Back-lighting devices 

45 Fig. 19 illustrates the construction of a picture- 
taking system in which a modified back-lighting de- 
vice is used. 

The system shown in Fig. 19 has a similar con- 
struction to that of the fourth embodiment shown in 

so Fig. 15, except for that the Fig. 19 system includes a 
spatial modulation device 10 and a Fresnel lens 11 
(as optical element). The operation of an image out- 
put apparatus 90 is different that of the apparatus 1 9 
of Fig. 15, which will be described below. 

55 Referring to Figs. 20A and 20B, two-level value 

representation of an image according to Fig. 19 sys- 
tem will be described below. 

Two-level gradation black-and-white liquid crys- 
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tal display 12 provides with a high- brightness back- 
lighting device which is always lighted wherein light 
emitted from the back-lighting device is passed 
through or blocked off by a liquid crystal shutter. A flu- 
orescent lamp, metal halide lamp, or the like can be 
used here as the back-lighting device. 

In the case of multilevel gradation display sys- 
tems such as the black-and-white CRT 12 used in the 
previous embodiments, images of portions other than 
a half-face area are also displayed as shown n Fig. 
20A. In the present invention, however, it is undesir- 
able that images other than a half-face area are dis- 
played as a back-lighting device. 

In contrast, when a two-level gradation black- 
and-white liquid crystal display is used, images hav- 
ing brightness levels less than a predetermined 
threshold level are automatically cut off and not dis- 
played. Thus, the portions having the cross sections 
denoted by "Image Cross Section 1" in Fig. 20A are 
not displayed. As for the portions having the cross 
sections denoted by "Image Cross Section 2", their 
peripheral areas are cut out and images having cross 
sections denoted by "Image Cross Section 3" in Fig. 
20B are displayed. As can be seen from the above 
discussion, if a two-level gradation black-and-white 
liquid crystal display which is usually used for display- 
ing characters is used as the observer's-! mage dis- 
play device instead of the black-and-white CRT, dis- 
playing of two-level face images are easily achieved 
and thus only high-brightness portions of half-face 
areas which are essential as back-lighting devices 
are selectively displayed whereby crosstalk between 
right and left images is suppressed. 

In this modified system, two ultrasonic waves 
having different wavelengths generated by the ultra- 
sonic wave generators 27a and 27b are reflected 
from two observers, and detected by the ultrasonic 
wave detectors 28a and 28b, respectively. From the 
detected signals, the ultrasonic wave image output 
device 29 calculates the positions of images corre- 
sponding to right-side and left-side face areas of the 
observers to be displayed on the black-and-white 
CRTs 12a and 12b, and then outputs predetermined 
images for right-side faces and images for left-side 
faces to the black-and-white CRT 12, so as to display 
these images on the black-and-white CRT 12. In this 
processing, it is easy to display only images corre- 
sponding to observers' faces on the black-and-white 
CRT 12 and display nothing other than those images. 
Therefore, it is possible to prevent crosstalk between 
right and left images in which the left eye (right eye) 
gets weak perception of the right-eye (left-eye) image 
due to disturbance in light. 

Further Modifications 

In the embodiments described above in connec- 
tion with Figs. 3 through 19, observers' positions are 



detected using infrared light rays having different wa- 
velengths (or ultrasonic waves having different fre- 
quencies), and corresponding images for left eyes 
are formed. For the above purpose, a pair of infrared 

5 LED light sources (13a, 13b), a pair of cameras (14a, 
1 4b), and a pair of ultrasonic wave generators and de- 
tectors. Alternatively, infrared light rays having differ- 
ent wavelengths (or ultrasonic waves different fre- 
quencies) may be emitted at different times using 

10 only one infrared LED light source or one ultrasonic 
wave generator. 

Furthermore, the half mirror 15 for synthesizing 
images may be replaced with a prism system, and 
Fresnel lenses 11a, 11b may be replaced with con- 

15 cave mirrors. 

The present invention is not limited to the above 
embodiments and various changes and modifica- 
tions can be made within the spirit and scope of the 
present invention. Therefore, to appraise the public of 

20 the scope of the present invention, the following 
claims are made. 



Claims 

25 

1. An image display system for providing first and 
second images such that a right eye and a left 
eye of an observer see the first and second im- 
ages at different times, respectively, the image 
30 display system comprising: 

picture-taking means for taking a picture 
of the observer and then outputting an image of 
the observer; 

a spatial modulation device transparent to 
35 light, for displaying the first and second images 
at the different times, respectively; 

generation means for generating a pair of 
back light images based on an image output sig- 
nal from the picture-taking means at the different 
40 times, respectively; 

a back-lighting device which receives an 
output signal associated with the back light image 
generated by the back light image generation 
means and displays the back light images to illu- 
45 minate the spatial modulation devices from a 
back side thereof, at the different times; 

synchronization means for synchronizing 
one of the first and second images present on the 
spatial modulation device with a generation of 
so one of the pair of back light images by the gener- 

ation means; and 

an optical element for giving directivity to 
back light emitted by the back-lighting device so 
that the back-lighting device provides back light 
55 illuminations of the spatial modulation device for 

the right and left eyes at the different times, 
wherein 

the generation means comprises: 
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image processing means for processing 
an image of the observer taken by the picture tak- 
ing means, detecting a contour and/or a centroid 
of the face area of the image of the observer, and 
then generating the pair of back light images on 
the basis of the detected contour and/or centroid. 

2. A display system according to claim 1, wherein 
the generation means generates a back light im- 
age corresponding to the image of the observer's 
face taken by the picture-taking means. 

3. A display system according to claim 2, wherein 
the picture-taking means includes: 

illuminating devices for illuminating an ob- 
server face with light having specific wave- 
lengths; 

cameras for taking a picture of the obser- 
ver's face in such a manner that each the camera 
selectively takes a picture in response to light 
having the corresponding wavelength. 

4. A display system according to claim 2, wherein 
the illuminating devices are attached to the ob- 
server so that the illuminating devices move fol- 
lowing the movement of the head of the observer. 

5. A display system according to claim 3, wherein 
the cameras are each provided with a wavelength 
filter which selectively passes light emitted by the 
illuminating devices. 

6. A display system according to claim 1, wherein 
the back lighting device is disposed outside the 
focal length of the optical element 

7. A display system according to claim 1, wherein 
the optical element is disposed between the spa- 
tial modulation device and the back-lighting de- 
vice. 

8. A display system according to claim 1 , wherein 
the spatial modulation device comprises a liquid 
crystal display device. 

9. A display system according to claim 1, wherein: 

the spatial modulation device inputs im- 
age signals representing the first and second im- 
ages taken by an endoscope device; and wherein 

the endoscope device includes: 

a pair of lens tubes for transmitting im- 
ages of an object to be observed as stereoscopic 
vision, the images of the object being taken at two 
different viewing angles; and 

a pair of image sensing devices for con- 
verting the pair of obtained images to corre- 
sponding electric signals. 



10. A display system according to claim 7, wherein 
the optical element is a convex lens, concave mir- 
ror or Fresnel lens. 

5 11. An image display system for providing first and 
second images such that a right eye and a left 
eye of an observer see the first and second im- 
ages at different times, respectively, the image 
display system comprising: 

10 picture-taking means for taking a picture 

of the observer and then outputting an image of 
the observer; 

a spatial modulation device transparent to 
light, for displaying the first and second images 

15 at the different times, respectively; 

generation means for generating a pair of 
back light images based on an image output sig- 
nal from the picture-taking means at the different 
times, respectively; 

20 a back-lighting device which receives an 

output signal associated with the back light image 
generated by the back light image generation 
means and displays the back light images to illu- 
minate the spatial modulation devices from a 

25 back side thereof, at the different times; 

synchronization means for synchronizing 
one of the first and second images present on the 
pair of spatial modulation devices with a genera- 
tion of one of the pair of back light images by the 

30 generation means; and 

an optical element for giving directivity to 
back light emitted by the back-lighting device so 
that the back-lighting device provides back light 
illuminations of the spatial modulation device for 

35 the right and left eyes at the different times, 
wherein 

the picture-taking means comprises: 
a plurality of camera means having differ- 
ent sensitivity characteristics; and 

40 a plurality of illumination means having 

characteristics corresponding to the sensitivity 
characteristics of the plurality of camera means; 
Wherein, in use, the plurality of camera means 
and the plurality of illumination means are dis- 

45 posed in front of a plurality of observers in such 
a manner that they are distributed in the direction 
from the front to the back of the plurality of obser- 
vers. 

50 12. A display system according to claim 11, wherein 
the plurality of illumination means and the plural- 
ity of camera means are distributed in the direc- 
tion from the left to the right as well as in the di- 
rection from the front to the back of the plurality 

55 of observers. 

13. A display system according to claim 11, wherein 
the picture-taking means takes a picture of the 
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observer. 

14. A display system according to claim 13, wherein 
the picture-taking means separates an image of 
a left-side face area and an image of right-side 
face area from the image of the observer's face, 
and then displays the image of the left-side face 
area and the image of right-side face area as the 
pair of the back light images on the back-lighting 
device, respectively. 

15. A display system according to claim 11, wherein 
the plurality of camera means comprise a plural- 
ity of pairs of cameras, and the plurality of illumin- 
ation means comprise a plurality of pairs of illu- 
minating devices, 

each pair of illuminating devices are dis- 
tributed in a transversal direction before the ob- 
servers, and illuminate the observer faces in 
such a manner that a right-side face area and a 
left-side face area are illuminated with light hav- 
ing different wavelengths; 

the plurality of pairs of cameras are distrib- 
uted in the transverse and back-and forth direc- 
tions of the observers, each pair of cameras tak- 
ing a picture of said observer's face in such a 
manner that each said camera selectively takes 
a picture in response to light having a corre- 
sponding wavelength. 

16. A display system according to claim 15, further 
comprising: 

means for determining the difference be- 
tween a pair of image signals associated with the 
observer obtained via the pair of cameras, and 
further removing a background image from the 
pair of image signals on the basis of the differ- 
ence. 

17. A display system according to claim 15, wherein 
the pair of illuminating devices are attached to 
the observer so that the pair of illuminating devic- 
es move following the movement of the head of 
the observer. 

18. A display system according to claim 15, wherein 
the pair of cameras are each provided with a wa- 
velength filter which selectively passes light 
emitted by the pair of illuminating devices. 

19. A display system according to claim 11, wherein 
the back lighting device is disposed outside the 
focal length of the optical element 

20. A display system according to claim 11, wherein 
the optical element is disposed between the spa- 
tial modulation device and the back-lighting de- 
vice. 



21. A display system according to claim 11, wherein 
the spatial modulation device comprises a liquid 
crystal display device. 

5 22. A display system according to claim 11, wherein: 
the spatial modulation device inputs im- 
age signals representing the first and second im- 
ages taken by an endoscope device; and wherein 
the endoscope device includes: 
10 a pair of lens tubes for transmitting im- 

ages of an object to be observed as stereoscopic 
vision, the images of the object being taken at two 
different viewing angles; and 

a pair of image sensing devices for con- 
is verting the pair of obtained images to corre- 
sponding electric signals. 

23. A display system according to claim 11, wherein 
the optical element is a convex lens, concave mir- 

20 ror or Fresnel lens. 

24. An image display system for providing first and 
second images such that a right eye and a left 
eye of an observer see the first and second im- 

25 ages at different times, respectively, the image 
display system comprising: 

picture-taking means for taking a picture 
of the observer and then outputting an image of 
the observer; 

30 a spatial modulation device transparent to 

light, for displaying the first and second images 
at the different times, respectively; 

generation means for generating a pair of 
back light images based on an image output sig- 

35 nal from the picture-taking means at the different 
times, respectively; 

a back-lighting device which receives an 
output signal associated with the backlight image 
generated by the back light image generation 

40 means and displays the back light images to illu- 

minate the spatial modulation device from a back 
side thereof, at the different times; 

synchronization means for synchronizing 
one of the first and second images present on the 

45 spatial modulation device with a generation of 
one of the pair of back light images by the gener- 
ation means; and 

an optical element for giving directivity to 
back light emitted by the back-lighting device so 

so that the back-lighting device provides back light 

illuminations of the spatial modulation device for 
the right and left eyes at the different times, 
wherein 

the generation means comprises: 
55 means for processing the image of the ob- 

server taken by said picture-taking means in 
such a manner that the positions of bright points 
associated with the image of the observer are de- 
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tected and then said pair of back light images are 
generated on the basis of said detected positions 
of bright points. 

25. A display system according to claim 24 wherein 
the generation means generates back light im- 
ages corresponding to the image of the obser- 
ver's face taken by the picture-taking means. 

26. A display system according to claim 24, wherein 
the image processing means separates an image 
of a left-side face area and an image of right-side 
face area from the image of the observer's face, 
and then displays the image of the left-side face 
area and the image of right-side face area on the 
pair of back-lighting device, respectively. 

27. A display system according to claim 24, wherein 
the picture-taking means includes: 

illuminating devices for illuminating an ob- 
server face with light having specific wave- 
lengths; 

cameras for taking a picture of the obser- 
ver's face in such a manner that each the camera 
selectively takes a picture in response to light 
having the corresponding wavelength. 

28. A display system according to claim 27, wherein 
the illuminating devices are attached to the ob- 
server so that the illuminating devices move fol- 
lowing the movement of the head of the observer. 

29. A display system according to claim 27, wherein 
the cameras are each provided with a wavelength 
filter which selectively passes light emitted by the 
illuminating devices. 

30. A display system according to claim 27, wherein 
the back lighting device is disposed outside the 
focal length of the optical element 

31. A display system according to claim 27, wherein 
the optical element is disposed between the spa- 
tial modulation device and the back-lighting de- 
vice. 

32. A display system according to claim 27, wherein 
the spatial modulation device comprises a liquid 
crystal display device. 

33. A display system according to claim 27, wherein: 

the spatial modulation device inputs im- 
age signals representing the first and second im- 
ages taken by an endoscope device; and wherein 
the endoscope device includes: 
a pair of lens tubes for transmitting im- 
ages of an object to be observed as stereoscopic 
vision, the images of the object being taken at two 



different viewing angles; and 

a pair of image sensing devices for con- 
verting the pair of obtained images to corre- 
sponding electric signals. 

5 

34. A display system according to claim 31, wherein 
the optical element is a convex lens, concave 
lens or Fresnel lens. 

10 35. An image display system for providing first and 
second images such that a right eye and a left 
eye of an observer see the first and second im- 
ages at different times, respectively, the image 
display system comprising: 

15 picture-taking means for taking a picture 

of the observer and then outputting an image of 
the observer, 

a spatial modulation device transparent to 
light, for displaying the first and second images 

20 at the different times, respectively; 

generation means for generating a pair of 
back light images based on an image output sig- 
nal from the picture-taking means at the different 
times, respectively; 

25 a back-lighting device which receives an 

output signal associated with the back light image 
generated by the back light image generation 
means and displays the back light images to illu- 
minate the spatial modulation device from a back 

30 side thereof, at the different times; 

synchronization means for synchronizing 
one of the first and second images present on the 
spatial modulation device with a generation of 
one of the pair of back light images by the gener- 

35 ation means; and 

an optical element for giving directivity to 
back light emitted by the back-lighting device so 
that the back-lighting device provides back light 
illuminations of the spatial modulation device for 

40 the right and left eyes at the different times, 
wherein 

the optical element is a Fresnel lens 
formed on a surface of the spatial modulation de- 
vice in an integral fashion. 

45 

36. A system according to claim 35, wherein the Fres- 
nel lens is provided on the back surface of the 
spatial modulation device that is closer to the 
back-lighting device. 

50 

37. A system according to claim 35, wherein the spa- 
tial modulation device comprises a liquid crystal 
display device which has a glass substrate on a 
back surface thereof, the glass which is provided 

55 with a pattern of ring bands serving as a Fresnel 

lens. 

38. A display system according to claim 35, wherein 
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the generation means generates a back light im- 
age corresponding to the image of the observer's 
face taken by the picture-taking means. 

39. A display system according to claim 38, wherein 
the picture-taking means separates an image of 
a left-side face area and an image of right-side 
face area from the image of the observer's face, 
and then displays the image of the left-side face 
area and the image of right-side face area on the 
pair of back-lighting device, respectively. 

40. A display system according to claim 38, wherein 
the picture-taking means includes: 

a pair of illuminating devices for illuminat- 
ing an observer face in such a manner that a 
right-side face area and a left-side face area are 
illuminated with light having different wave- 
lengths; 

a pair of cameras for taking a picture of the 
observer's face in such a manner that each the 
camera selectively takes a picture in response to 
light having the corresponding wavelength. 

41- A display system according to claim 40, further 
comprising: 

means for determining the difference be- 
tween a pair of image signals associated with the 
observer obtained via the pair of cameras, and 
further removing a background image from the 
pair of image signals on the basis of the differ- 
ence. 

42. A display system according to claim 40, wherein 
the pair of illuminating devices are attached to 
the observer so that the pair of illuminating devic- 
es move following the movement of the head of 
the observer. 

43. A display system according to claim 40, wherein 
the pair of cameras are each provided with a wa- 
velength filter which selectively passes light 
emitted by the pair of illuminating devices. 

44. A display system according to claim 35, wherein 
the back lighting device is disposed outside the 
focal length of the Fresnel lens. 

45. A display system according to claim 35, wherein 
the spatial modulation device comprises a liquid 
crystal display device. 

46. A display system according to claim 35, wherein: 

the spatial modulation device inputs im- 
age signals representing the first and second im- 
ages taken by an endoscope device; and wherein 
the endoscope device includes: 
a pair of lens tubes for transmitting im- 



ages of an object to be observed as stereoscopic 
vision, the images of the object being taken at two 
different viewing angles; and 

a pair of image sensing devices for con- 
5 verting the pair of obtained images to corre- 

sponding electric signals. 

47. An image display system for providing first and 
second images such that a right eye and a left 

10 eye of an observer see the first and second im- 
ages at different times, respectively, the image 
display system comprising: 

picture-taking means for taking a picture 
of the observer and then outputting an image of 
15 the observer; 

a spatial modulation device transparent to 
light, for displaying the first and second images 
at the different times, respectively; 

generation means for generating a pair of 
20 back light images based on an image output sig- 
nal from the picture-taking means at the different 
times, respectively; 

a back-lighting device which receives an 
output signal associated with the back light image 
25 generated by the back light image generation 
means and displays the back light images to illu- 
minate the spatial modulation device from a back 
side thereof, at the different times; 

synchronization means for synchronizing 
30 one of the first and second images present on the 
spatial modulation device with a generation of 
one of the pair of back light images by the gener- 
ation means; and 

an optical element for giving directivity to 
35 back light emitted by the back-lighting device so 

that the back-lighting device provides back light 
illuminations of the spatial modulation device for 
the right and left eyes at the different times, 
wherein 

40 the back light device displays images with 

two-level gradation having a threshold value 
equal to predetermined brightness. 

48. A display system according to claim 47, wherein 
45 the generation means generates a back light im- 
age corresponding to the image of the observer's 
face taken by the picture-taking means. 

49. A display system according to claim 47, wherein 
50 the picture-taking means separates an image of 

a left-side face area and an image of right-side 
face area from the image of the observer's face, 
and then displays the image of the left-side face 
area and the image of right-side face area on the 
55 pair of back-lighting device, respectively. 

50. A display system according to claim 48, wherein 
the picture-taking means includes: 
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a pair of illuminating devices for illuminat- 
ing an observer face in such a manner that a 
right-side face area and a left-side face area are 
illuminated with light having different wave- 
lengths; 

a pair of cameras for taking a picture of the 
observer's face in such a manner that each the 
camera selectively takes a picture in response to 
light having the corresponding wavelength. 

51. A display system according to claim 50, further 
comprising: 

means for determining the difference be- 
tween a pair of image signals associated with the 
observer obtained via the pair of cameras, and 
further removing a background image from the 
pair of image signals on the basis of the differ- 
ence. 

52. A display system according to claim 50, wherein 
the pair of illuminating devices are attached to 
the observer so that the pair of illuminating devic- 
es move following the movement of the head of 
the observer. 

53. A display system according to claim 50, wherein 
the pair of cameras are each provided with a wa- 
velength filter which selectively passes light 
emitted by the pair of illuminating devices. 

54. A display system according to claim 47, wherein 
the back lighting device is disposed outside the 
focal length of the optical element 

55. A display system according to claim 47, wherein 
the optical element is disposed between the spa- 
tial modulation device and the back-lighting de- 
vice. 

56. A display system according to claim 47, wherein 
the spatial modulation device comprises a liquid 
crystal display device. 

57. A display system according to claim 47, wherein: 

the spatial modulation device inputs im- 
age signals representing the first and second im- 
ages taken by an endoscope device; and wherein 

the endoscope device includes: 

a pair of lens tubes for transmitting im- 
ages of an object to be observed as stereoscopic 
vision, the images of the object being taken at two 
different viewing angles; and 

a pair of image sensing devices for con- 
verting the pair of obtained images to corre- 
sponding electric signals. 

58. A display system according to claim 47, wherein 
the optical element is a convex lens or Fresnel 



lens. 

59. An image display system for providing first and 
second images such that a right eye and a left 
5 eye of an observer see the first and second im- 

ages at different times, respectively, the image 
display system comprising: 

picture-taking means for taking a picture 
of the observer and then outputting an image of 
10 the observer; 

generation means for generating a pair of 
back light images based on an image output sig- 
nal from the picture-taking means; 

a spatial modulation device having first 
15 and second liquid crystal layers transparent to 
light, for displaying the first and second images 
in a time division fashion; 

a back-lighting device for illuminating the 
spatial modulation device from a back side there- 
20 of by displaying the back light images; and 

an optical element, disposed between the 
spatial modulation device and the back-lighting 
device, for giving directivity to back light emitted 
by the back-lighting device so that the back- 
25 lighting device provides back light illuminations of 
the spatial modulation device for the right and left 
eyes, 

wherein the back light images are dis- 
played in a time-division fashion in a synchroni- 
se zation with a time division display of the spatial 
modulation device, the back light images being 
displayed at positions corresponding to the right 
and left face areas, respectively. 

35 60. An image display system for providing first and 
second images such that a right eye and a left 
eye of an observer see the first and second im- 
ages at different times, respectively, the image 
display system comprising: 

40 detecting means for detecting a position of 

the observer, 

generation means for generating a pair of 
back light images based on a detected position of 
the observer; 

45 a spatial modulation device having first 

and second liquid crystal layers transparent to 
light, for displaying the first and second images 
in a time division fashion; 

a back-lighting device for illuminating the 

so spatial modulation device from a back side there- 
of by displaying the back light images; and 

an optical element, disposed between the 
spatial modulation device and the back-lighting 
device, for giving directivity to back light emitted 

55 by the back-lighting device so that the back- 

lighting device provides back light illuminations of 
the spatial modulation device for the right and left 
eyes, 
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wherein the back light images are dis- 
played in a time-division fashion in a synchroni- 
zation with a time division display of the spatial 
modulation device, the back light images being 
displayed at positions corresponding to the right 5 
and left face areas, respectively. 

61. A display system according to claim 60, wherein 
the detection means detects the position of the 
observer by using an ultrasonic beam. w 
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